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Abstract 

Computing the winning set for Biichi objectives in alternating games on graphs is a central problem in 
computer aided verification with a large number of applications. The long standing best known upper bound 
for solving the problem is 0(n ■ m), where n is the number of vertices and m is the number of edges in the 
graph. We are the first to break the 0(n-m) boundary by presenting a new technique that reduces the running 
time to 0(n 2 ). This bound also leads to 0(n 2 ) time algorithms for computing the set of almost-sure winning 
vertices for Biichi objectives (1) in alternating games with probabilistic transitions (improving an earlier bound 
of 0(n ■ m)), (2) in concurrent graph games with constant actions (improving an earlier bound of 0(n 3 )), and 
(3) in Markov decision processes (improving for m > n 4 / 3 an earlier bound of 0(min(rn 1 - 5 , m ■ n 2 / 3 )). We 
also show that the same technique can be used to compute the maximal end-component decomposition of a 
graph in time 0(n 2 ), which is an improvement over earlier bounds for m > n 4 / 3 . Finally, we show how to 
maintain the winning set for Biichi objectives in alternating games under a sequence of edge insertions or a 
sequence of edge deletions in 0(n) amortized time per operation. This is the first dynamic algorithm for this 
problem. 

Keywords: (1) Graph games; (2) Biichi objectives; (3) Graph algorithms; (4) Dynamic graph algorithms; (5) 
Computer-aided verification. 

1 Introduction 

Consider a directed graph (V, E) with a partition (Vi , V2) of V and a set B C V of Biichi vertices. This graph is 
called a game graph. Let n = \V\ and m = \E\. Two players play the following alternating game on the graph 
that forms an infinite path. They start by placing a token on an initial vertex and then take turns indefinitely in 
moving the token: At a vertex v € V\ player 1 moves the token along one of the out-edges of v, at a vertex u € V2 
player 2 moves the token along one of the out-edges of u. A first question to ask is given a start vertex x € V 
can player 1 guarantee that the infinite path visits a vertex in B at least once, no matter what choices player 2 
makes. If so player 1 can win from x and x belongs to the winning set of player 1. The question of computing the 
set of vertices from which player 1 can win (called the winning set) is called the (alternating) reachability game 
problem. The problem is PTIME-complete and the winning set of player 1 can be computed in time linear in the 
size of the graph (HQS!. A second, more central question is whether player 1 can guarantee that the infinite path 
visits a vertex in B infinitely often, no matter what choices player 2 makes. Computing the winning set of player 
1 for this setting is called the (alternating) Biichi game problem. The best known algorithms for this problem are 
algorithms that repeatedly compute the alternating reachability game solution on the graph after the removal of 
specific vertices. Their running time is 0(n ■ m). We present in this paper a new algorithmic technique for the 
alternating Biichi game problem which is inspired by dynamic graph algorithms and which reduces the running 
time to 0(n 2 ). 

Two-player games on graphs played by player 1 and the adversary player 2 are central in many problems 
in computer science, specially in verification and synthesis of systems such as the synthesis of systems from 
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specifications and synthesis of reactive systems lfTTH26ll27l . verification of open systems [1], checking interface 
compatibility [14], well-formedness of specifications lPT5ll , and many others. Besides their application in 
verification, they have also been studied in artifical intelligence as AND-OR graphs 11241 . and in the context 
of alternating Turing machines (6]. 

The class of Biichi or repeated reachability objectives was introduced in the seminal works of Biichi ESI [5) 
in the context of automata over infinite words. The alternating Biichi game problem is one of the core problems in 
verification and synthesis. For example, (a) the solution of the synthesis problem for deterministic Biichi automata 
is achieved through solving the alternating Biichi game problem (see [23 ] for the importance of deterministic 
Biichi automata); and (b) the verification of open systems with liveness and weak fairness conditions (two key 
specifications used in verification) is again solved through alternating Biichi game problem [1]. Vardi ll30l 1291 
discusses further applications of the alternating Biichi game problem and its importance. The classical algorithm 
for alternating Biichi games follows from the results of lfl6l 12511311 . its complexity is 0(n ■ m). The algorithm 
was improved in the special case of game graphs with m = 0(n) to 0(n 2 / log n) time in J3. A generalization 
of the algorithm from [9 ] was presented in JSJ, and the new algorithm requires 0((n ■ m • log A)/ log n) time, 
where A is the maximum out-degree. Thus the long standing best known upper bound for solving the alternating 
Biichi game problem is 0(n ■ m). 

In the design and verification of open systems it is natural that the systems under verification are developed 
incrementally by adding choices or removing choices for the system, which is represented by player 1 . However 
the adversary, modeled by player 2, is the environment, and the system design has no control over the environment 
actions. Hence there is a clear motivation to obtain dynamic algorithms for the alternating Biichi game problem, 
when edges leaving player- 1 vertices are inserted or deleted, while edges leaving player-2 vertices remain 
unchanged. 

Our contributions. In this work we present improved static and the first dynamic algorithms for the alternating 
Biichi game problem using graph algorithmic techniques. Our main results are as follows. 

1. We present an 0{n 2 ) time algorithm for the alternating Biichi game problem, and thus break the long 
standing barrier of 0(n-m) for the problem. It follows that in combination with the 0(n 2 / log n) algorithm 
for m = 0(n), we break the 0(n ■ m) barrier for all cases. 

2. We present the first incremental and decremental algorithms for the alternating Biichi game problem for 
insertion and deletion of player- 1 edges. Our algorithm is based on the progress measure algorithm of [ 20 ] 
and generalizes the Even-Shiloach algorithm for decremental reachability in undirected graphs [17]. The 
total time for all operations is 0(n • m), i.e., the amortized time per operation is 0(n). 

3. Using our techniques to solve alternating Biichi games we also show that the maximal end-component 
decomposition problem (a core problem in probabilistic verification) can also be solved in 0(n 2 ) time 
(see [13] and other references of Q for the importance of the problem). The best known bound for this 
problem was 0(min(m 15 ,m • n 2 / 3 )) 0. Thus, our algorithm is faster for m > n 4 / 3 and we obtain an 
improved bound of 0(min(m L5 , n 2 )) for the problem. 

Decremental and incremenal algorithms for computing the maximal end-component decomposition was given 
in Q. However, our algorithms are the first dynamic algorithms for the alternating Biichi game problem and 
completely different from 0. Our result for alternating Biichi games improves the bounds for other problems as 
well. We list them below. 

1. The problem of computing the set of almost-sure (or probability 1) winning vertices in alternating games 
with probabilistic transitions (aka simple stochastic games lfl2l ) and Biichi objectives can be solved in 
0(n 2 ) time improving the previous known 0(n • m) bound: this follows from the linear reduction of ifTUl 
from simple stochastic games to alternating Biichi games for almost-sure winning and our Biichi games 
algorithm. 

2. The problem of computing the set of almost-sure (probability 1) and limit-sure (probability arbitrarily 
close to 1) winning vertices in concurrent graph games (aka games with simultaneous interaction) with 



constant actions with Biichi objectives can be solved in 0(n 2 ) time: this follows from the linear reduction 
from concurrent games to alternating Biichi games ETTl and our Biichi algorithm. The best known bound 
for concurrent graph games with constant actions with Biichi objectives was 0(n ■ \d\), where \S\ is the 
number of transitions which is 0(n 2 ) in the worst case. Thus, in the worst case the previous best known 
bound was 0(n 3 ). 

3. As a consequence of our 0(n 2 ) algorithm for Biichi games and the linear reduction of ifTOl . we also obtain 
an 0{n 2 ) algorithm for computing almost-sure winning states for Markov decision processes with Biichi 
objectives. The best known bound for this problem was 0(min(m , m ■ n 2 / 3 )) Q. Thus, our algorithm 
is faster for m > n 4//3 and we obtain an improved bound of 0(min(m L5 , n 2 )) for the problem. 

Our main technical contribution is twofold: (1) The classical algorithm for alternating Biichi games 
repeatedly removes non-winning vertices from the game graph and then recomputes the player- 1 winning set for 
the alternating reachability game problem. Similar to the classical algorithm our algorithm repeatedly removes 
non-winning vertices from the game graph. However, it finds these vertices more efficiently using a hierarchical 
graph decomposition technique. This technique was used first by Henzinger et al. lPT8l for processing repeated 
edge deletions in undirected graphs. We show how this technique can be extended to work for vertex deletions 
in (directed) game graphs. As a result we achieve faster algorithms for the alternating Biichi game problem and 
for computing the maximal end-component decomposition. Moreover, even in sparse graphs, our technique can 
be useful. If m = c ■ n and c is a large constant, then our hiercharical decomposition can be used with a small 
number of levels, such as 2 or 3, to speed up the algorithm in practice. 

(2) Even and Shiloach [ 17'] gave a deletions-only algorithm for maintaining reachability in undirected graphs. 
We show how to extend this algorithm to edge deletions in directed game graphs. A purely graph-theoretic proof 
of the correctness of the new algorithm would be lengthy. However, by using an elegant argument based on 
fix-points we give a simple proof of the correctness and an analysis of the running time of the new algorithm. 
The new algorithm is simple and, like the algorithm in iTTTl . does not need any sophisticated data structures. We 
use a "dual" fix point argument to construct an incremental algorithm for alternating Biichi games. 

The paper is organized as follows: We give all necessary definitions in Section |2] Section [3] and Section @] 
contain the new static algorithms for the alternating Biichi game and the maximal end-component decomposition 
problem. Section |5]finally contains the new dynamic algorithms. 

2 Definitions 

Alternating Game graphs. An (alternating) game graph G = ((V,E), (Vi, V2)) consists of a directed graph 
(V, E) with a set V of n vertices and a set E of m edges, and a partition (V\, V2) oiV into two sets. The 
vertices in V\ are player 1 vertices and the vertices in V% are player 2 vertices. For a vertex u G V, we write 
Out(u) = {v G V I (u,v) G E} for the set of successor vertices of u and \n(u) = {v G V \ (v, u) G E} 
for the set of incoming edges of u. We assume that every vertex has at least one out-going edge, i.e., Out(u) is 
non-empty for all vertices u G V. 

Plays. A game is played by two players: player 1 and player 2, who form an infinite path in the game graph 
by moving a token along edges. They start by placing the token on an initial vertex, and then they take moves 
indefinitely in the following way. If the token is on a vertex in V\, then player 1 moves the token along one of 
the edges going out of the vertex. If the token is on a vertex in V%, then player 2 does likewise. The result is an 
infinite path in the game graph, called plays. We write Q for the set of all plays. 

Strategies. A strategy for a player is a rule that specifies how to extend plays. Formally, a strategy a for 
player 1 is a function a: V\ — V V such that a(v) G Out(v) for all v G V\, and analogously for player 2 
strategical We write £ and II for the sets of all strategies for player 1 and player 2, respectively. Given a 
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starting vertex v G V, a strategy a G E for player 1, and a strategy ir G II for player 2, there is a unique play, 
denoted u>(u,o-, 7r) = {vq,vi,V2, • • •)> which is defined as follows: -uo = v and for all k > 0, if G Vi, then 

c(vfc) = Ufc+i, and if Ufc G V 2 , then 7r(-u fc ) = 

Objectives. We consider game graphs with a Biichi objective for player 1 and the complementary coBiichi 
objective for player 2. For a play u = (vo, v\, v%, . . .) G 0, we define Inf(w) = {v G V \ 
Vk = v for infinitely many k > 0} to be the set of vertices that occur infinitely often in oj. We also define reach- 
ability and safety objectives as they will be useful in the analysis of the algorithms. 

1. Reachability and safety objectives. Given a set T C V of vertices, the reachability objective Reach (T) 
requires that some vertex in Tbe visited, and dually, the safety objective Safe(F) requires that only vertices 
in F be visited. Formally, the sets of winning plays are Reach(T) = {(vq,v\,V2, ■ • •} G O | 3A; > 0. G 
T} and Safe(F) = { (vo , v\ , v 2 , . . .} G Q [ VA; > 0. v& G F}. The reachability and safety objectives are 
dual in the sense that Reach(T) = fi \ Safe(V \ T). 

2. Biichi and coBiichi objectives. Given a set B C V of vertices, the Biichi objective Buchi(S) requires that 
some vertex in B be visited infinitely often, and dually, the coBiichi objective coBuchi(C) requires that 
only vertices in C be visited infinitely often. Thus, the sets of winning plays are Buchi(B) = {oj G SI | 
Inf (cj) fl B 7^ 0} and coBuchi(C) = {00 £ Q, \ Inf (w) C C}. The Biichi and coBiichi objectives are dual 
in the sense that Buchi(i?) = O, \ coBuchi(y \ B). Observe that Biichi and coBiichi objectives are tail (or 
prefix-independent) objectives, i.e., a play satisfies the objective if and only if the play obtained by adding 
or deleting a finite prefix also satisfies the objective. 

Winning strategies and sets. Given an objective C $7 for player 1, a strategy a G E is a winning 
strategy for player 1 from a vertex v if for all player 2 strategies tt G II the play u(v, a, tt) is winning, i.e., 
u)(v,a, 7r) G <)?. The winning strategies for player 2 are defined analogously by switching the role of player 1 
and player 2 in the above definition. A vertex v G V is winning for player 1 with respect to the objective 
$ if player 1 has a winning strategy from v. Formally, the set of winning vertices for player 1 with respect 
to the objective is = {v G V \ 3a G S. G II. cj(v,a, tt) G <3>} the set of all winning 

vertices. Analogously, the set of all winning vertices for player 2 with respect to an objective $ C is 
W 2 (tt) = {w G V I 3vr G II. Vo- G E. u(v,a,ir) G 

Theorem 2.1. (Classical memoryless determinacy |16]) For all game graphs G = 
((V, E), (Vi, V2)), all Biichi objectives Q for player 1, and the complementary coBiichi objective ^ = $7 \ § for 
player 2, we have Wi{$) =V \ W 2 (^). 

Thus the theorem shows that every vertex of V either belongs to the winning set of Biichi objectives of player 1 
or to the winning set of coBiichi objectives for player 2. Since we only consider this setting we simply say in the 
rest of the paper that every vertex either is winning for player 1 or winning for player 2. 

The algorithmic question in alternating graph games with Biichi objective $ is to compute the set Wi(<&). 

3 Algorithms for Biichi Games 

In this section we consider algorithms for Biichi games, and when we mention winning vertices or strategies we 
mean winning for Biichi objectives, unless explicitly mentioned otherwise. In this section we present the classical 
iterative algorithm for Biichi games to compute the winning sets. We then present our new algorithm. We start 
with the notion of closed sets, attractors, and alternating reachability which are key notions for the analysis of 
the algorithm. We present the graph theoretic definitions, and then present well-known facts that establish the 
connection of the graph definitions and strategies in alternating game graphs. 



memoryless strategy for a player at a vertex v iff there exists a winning strategy with memory for the player at v. Thus for simplicity we only consider the 
simpler class of memoryless strategies. 



Closed sets. A set U C V of vertices is a closed set for player 1 if the following two conditions hold: (a) For 
all vertices u G (U fl Vi), we have Out(u) C £7, i.e., all successors of player 1 vertices in {/ are again in f7; 
and (b) for all it G (U fl V2), we have Out(u) fl Z7 7^ 0, i.e., every player 2 vertex in J7 has a successor in U. 
The closed sets for player 2 are defined analogously as above by exchanging the roles of player 1 and player 2 
(exchanging V\ and V2). Every closed set U for player I G {1, 2}, induces a sub-game graph, denoted G \ U . 

Fact 1. Consider a game graph G, and a closed set U for player 1. Then the following assertions hold: 

1. Player 2 has a winning strategy for the objective Safe(£7) for all vertices in U, i.e., player 2 can ensure that 
if the play starts in U, then the play never leaves set U. 

2. For all T C V \ U, we have W\ (Reach (T)) fl C7 = 0, i.e., for any set T of vertices outside U, player 1 
does not have a strategy from vertices in U to ensure to reach T. 

3. If U n B = (i.e., there is no Biichi vertex in U), then every vertex in U is winning for player 2. 
Attractors. Given a game graph G, a set U C V of target vertices, and a player I G {1, 2}, the set Attr^U, G) 
(called attractor) is the set of vertices from which player £ has a strategy to reach a vertex in U against all 
strategies of the other player; that is, Attri(U,G) = Wg (Reach (U)). The set AttriQJ, G) can be defined 
inductively as follows: let R = U; let R i+i = Ri U {v G V\ \ Out(v) n R4 / 0} U {v G F 2 I Owi(u) C 
iij} for all j > 0; then Attr\{U, G) = Ui>o The inductive definition of Attr2(U, G) is analogous with 
Vi replaced by V2 and vice-versa. For all vertices v G Attr\{U, G), define rank(v) = i if v G i?« \ that is, 
rank{v) denotes the least i > such that u is included in Ri. Define a memory less strategy a G S for player 1 as 
follows: for each vertex v G (Attri(U, G) fl Vi) with rank(v) = i, choose a successor cr(u) G (R4-1 n Ont(u)) 
(such a successor exists by the inductive definition). It follows that for all vertex v G Attri(U, G) and all 
strategies ir G II for player 2, the play w(t> , a, ir) reaches U in at most \ Attr\ (U, G) j transitions. Observe that for 
I G {1, 2}, we have U C Attre(U, G), i.e., the set [7 always belongs to the attractor. 

Alternating reachability. For £ G {1, 2}, for a vertex u G Attrg(U, G) we say that u can alt^-reach the set f7. In 
other words, alt^-reach denotes that player I has a strategy to reach the target set, irrespective of the strategy of 
the other player. 

Fact 2. For all game graphs G, all players I G {1, 2}, and all sets U QV of vertices, the following holds: 

1. The set V \ Attr^U, G) is a closed set for player £, i.e., no player £ vertex in V \ Attri(U, G) has an edge 
to Attre(U, G) and every vertex of the other player in V \ Attre(U, G) has an edge in V \ Attrg(U, G). 

2. The set Attri(U,G) can be computed in time 0( \ Y2veAttr e (u G) 

\n(v)\) nam. 

COROLLARY 3.1. Every vertex in the set V \Attr% (B, G) is winning for player 2 and is not winning for player 1. 

3.1 Classical algorithm for Biichi games In this subsection we present the classical algorithm for Biichi 
games. We start with an informal description of the algorithm. 

Informal description of classical algorithm. The classical algorithm (Algorithm [TJ works as follows. We 
describe an iteration j of the algorithm: the set of vertices at iteration j is denoted by V 3 , the game graph by G J 
and the set of Biichi vertices B n V 3 by B 3 . At iteration j, the algorithm first finds the set of vertices R 3 from 
which player 1 can alti-reach the set B 3 , i.e., computes Attr±(B 3 ,G 3 ). The rest of the vertices Tr 3 = V 3 \ R 3 
is a closed subset for player 1, and Tr 3 fl B 3 = 0. Thus the set Tr 3 is winning for player 2 (by Corollary 13. lb . 
Then the set of vertices Wj+i, from which player 2 can alt2-reach the set Tr 3 , i.e., Attr2(Tr 3 , G 3 ) is computed. 
The set Wj+\ is winning for player 2, and not for player 1 in G 3 and also in G. Thus, it is removed from the 
vertex set to obtain game graph G 3+1 . The algorithm then iterates on the reduced game graph, i.e., proceeds to 
iteration j + 1 on G 3+l . In every iteration a linear-time attractor computation is performed with the current Biichi 
vertices as target to find the set of vertices which can alti -reach the Biichi set. Each iteration takes 0(m) time 
and the algorithm runs for at most 0(n) iterations, giving a total time of 0(n ■ m). The algorithm is formally 
described as Algorithm Q] The correctness proof of the algorithm shows that when the algorithm terminates, all 
the remaining vertices are winning for player 1 ll2"5ll28Tl . 



Algorithm 1 Classical algorithm for Buchi Games 

Input : A game graph G=({V,E), (V 1: V 2 ) and B C V. 
Output: W QV. 

1. G° := G; V° := V; 2. W := 0; 3. j := 
4. repeat 

4.1 T^+i := AvoidSetClassical(G»',S n V j ) 

4.2 := V j \ W j+1 ; G 3+1 = G \ V j+1 ; j := j + 1; 
until Wj = 

5- := (JLi W k ; 
6. return W. 

Procedure AvoidSetClassical 

Input: Game graph G 3 and B 3 C 
Output: set Wj+i C V^. 

1. i# := Attrx(Bi,G>y, 2. Tr 3 := V j \ R 3 ; 3. W j+1 := Attr 2 (Tr j ,G 3 ) 



Theorem 3.1. (Correctness and running time) Given a game graph G = ((V,E), (Vi,V 2 )) and B C 
V the following assertions hold: 

1. W = W 2 (coBuchi(F \ B)) and V \ W = Wi(Buchi(S)), where W is the output of Algorithm^ and 

2. the running time of Algorithm\J\is 0(n ■ m). 

3.2 New Algorithm In this section we present our new algorithm for computing the winning set for game 
graphs with Buchi objectives in time 0(n 2 ). 

Notations. Given an alternating game graph G = ((V, E), (V]_, V 2 )) and a set B of Buchi vertices, we label the 
Buchi vertices as priority vertices, and the set V \ B as priority 1 vertices. For every vertex v the inedges 
have & fixed order such that all edges from priority 1 player-2 vertices come before all other edges. We maintain 
log n graphs Gi such that Gi = (V, Ei). The set E{ contains all edges (u, v) where (a) outdeg(u) < 2\ where 
outdeg{u) = \Out(u) \ or (b) the edge (u,v) belongs to the first 2* inedges of vertex v. Note that C Ei 
since the order of the inedges is fixed. We color every player-1 vertex v in Gi blue if outdeg{v) > 2\ We color 
every player-2 vertex v in Gi orange if outdeg(v) > 2\ All other vertices have color white. For every vertex 
v that is white in Gi, all its outedges Out(v) are contained in Ei. These edges add up to 2* • n edges to Ei. 
Additionally the first up to 2' inedges of every vertex belong to Ei, adding another up to 2* • n edges to Ei. Thus 
\Ei\ < 2 l+1 ■ n. We denote by G the full graph. Note that G = Gi ogn and thus all vertices in Gi ogn are white. 

The new algorithm NewAlgo. The new algorithm consists of two nested loops, an outer loop with loop counter 
j and an inner loop with loop counter i. The algorithm will iteratively delete vertices from the graph, and we 
denote by Dj the set of vertices deleted in iteration j, and by U the set of vertices deleted in all iterations upto 
the current iteration (initially U is empty). For j > 1, we will denote by G\ the sub-graph of Gi induced after 
removal of the set U of vertices at the beginning of iteration j, and Gf is Gi (the initial graphs). We denote 
the vertex set in iteration j as V J and the Buchi set as B 3 (i.e., B 3 := V 3 n B). The intuitive description of 
the algorithm is as follows: Starting from i = the algorithm searches in each iteration j in each graph G\ 
for a special player-1 closed set Sj with no Buchi vertex and stop at the smallest i at which such a closed set 
exists. Since Sj PI B 3 = 0, Fact 1 implies that all the vertices in Sj are winning for player 2. Thus, by the same 
arguments as for the classical algorithm the player-2 attractor Attr 2 (S : G\) are winning for player 2 in G\ and, 
as our correctness proof shows, also winning in G. Thus they are removed from the vertex set and the algorithm 
iterates on the reduced game graph. Computing Sj takes time 0(2* • n) and, due to the fact that no such set was 



found in G\_ x we can show that Sj it contains at least 2 l ~ 1 vertices. Thus, using amortized analysis we charge 
0(n) to each of the 2 i_1 vertices in Sj that are removed, giving a total running time of 0(n 2 ). The details of 
NewAlgo follow. 

1. For j = 0, let Y := Attri(B,G°) (where G° is the initial game graph); X := V \ Y (i.e., X is 
the set of vertices that cannot alti-reach the Biichi vertices in the initial game graph G); and compute 
Dq := Attr2(X, G) using attractor computation. 

2. Remove the vertices of Dj from all logn graphs G\ to create graphs G{ +1 \ j := j + 1; and U := U U Dj\ 

3. » := 1; 

4. repeat 

(a) Let Z| be the vertices of V J ' that are (i) either orange with no outedges in G| or (ii) blue in G\ . 

(b) Compute the set Y? of vertices in G\ that can alti -reach the Biichi vertices or Z|, i.e., compute 
Y? := Attr\{Bi U Z|, Gj) using attractor computation. 

(c) Sj := y J \ Y? (i.e., W \ Attn(Bi U Zf , i := i + 1 

5. until Sj is non-empty or i = log n 

6. if Sj 7^ 0, then Dj := Attr^iSj, G J ) and go to Step 2, else the whole algorithm terminates and outputs 
V\U. 

Let U* be the set of vertices removed from the graph over all iterations and Y* = V \ U* be the output of 
the algorithm. We first show that Y* C Wi(<&), where <1> is the Biichi objective, i.e., Y* is winning for player 1. 
Then we show that U* n T^i( < i ) ) = (i.e., U* is not winning for player 1). Together with Theorem 12. II this 
shows that Y* = Wi(<J>) estabilishing the correctness of the algorithm. Finally we analyze the running time of 
the algorithm. 

Lemma 3.1. Let Y* be the output of NewAlgo, and let G* and B* be the game graph and the Biichi set on 
termination, respectively (i.e., G* is the graph induced byY* and B* is B PiY* ). The following assertions hold: 

1. Y* = Attr\{B* ,G*), i.e., player 1 can alt\-reach the set B* in G* from Y*. 

2. Y* is a player-2 closed set in the original game graph G. 

3. Y* C where $ is the Biichi objective. 

Proof. We prove the three parts below. 

1. Consider the last iteration j* of the outer loop of the algorithm. Since it is the last iteration, the set Sj* 
must be empty. It follows that % must have been log n in the last iteration of the repeat loop, i.e., the last 
iteration of the repeat loop considered G J logn = G* . Let i = logn. Note that all vertices are white in G* , 

i.e., Zf was empty. Hence we have Yf = Attr^B* U Zf ,G*) = Attr^B* ,G*). Hence the fact that 
Sj* was empty at the end of the iteration implies that \ Y? was empty, i.e., that all vertices of G* 
belong to Attn(B*,G*). Hence Y* = Attr x {B* ,G*). 

2. Whenever a set of vertices is deleted in any iteration, it is an player-2 attractor. Hence if a vertex u G 
would have an edge to a vertex v G U*, then u would have been included in U* (where U* = V \ Y*). 
Similarly for a player 1 vertex u G Y* n V\ it must have an edge in Y*, as we assume that it has at least 
one out-edge and if all its out-edges pointed to U* it would have been included in U* . It follows that Y * is 
a player-2 closed set in G. 

3. The result is obtained from the previous two items. Consider a memoryless attractor strategy a in G* for 
player- 1 that ensures that for all vertices in Y* the set B* is reached within \ Y*\ steps against all strategies 
of player-2. Moreover the strategy only chooses successor in Y*. Since Y* is a player-2 closed set, it 
follows that against all strategies of player-2 the set Y* is never left, thus it is ensured that B* is visited 
infinitely often. Hence the strategy a ensures that for all vertices v G Y* and all strategies ir we have 
u(v, a, 7r) G It follows that Y* C Wi($). 

The desired result follows. I 



To complete the correctness proof we need to show that if U* = V \ Y* , then U* n W\ (<&) = 0, where $ is 
the Biichi objective. We will show the result by induction on the number of iterations. Let us denote by Uj the 
set of vertices removed till iteration j. The base case is trivial as initially U is empty set. By inductive hypothesis, 
we assume for j > 1 we have Uj-i D Wi(<&) = 0, and then show that Uj D Wi(3>) = 0. Let G 3 be the alternating 
game graph obtained after removal of the set Uj-x of vertices. We will show the following claim. 

Claim 1. In G 3 , let Sj be the non-empty set identified in iteration j, then Attrx(B 3 ,G 3 ) n Sj = 0. 

In the following two lemmata we first show how with Claim 1 we establish the correctness of our algorithm and 
finally prove Claim 1 to complete the correctness proof. 

LEMMA 3.2. The inductive hypothesis that Uj-% fl Wi(<3?) = and Claim 1 implies that Sj fl Wi(<J>) = 0. 

Proof. By Claim 1 we have Attrx{B 3 ,G 3 ) n Sj = 0, and it follows that if player 1 follows a strategy from any 
vertex in Sj such that the set V 3 ' = V \ Uj-x of vertices is never left, then no Biichi vertex is ever reached. 
If the set V 3 is left after a finite number of steps, then the set Uj-x is reached, and by inductive hypothesis 
Uj-x n Wi(3>) = 0, i.e., player 2 can ensure from Uj-x that the set of Biichi vertices is visited finitely often. 
Since the Biichi objective is independent of finite prefixes, it follows that if V 3 ' is left and Uj-x is reached, then 
player 2 ensures that the Biichi objective is not satisfied. It follows that Sj fl Wi(3>) = 0. I 

LEMMA 3.3. The inductive hypothesis that Uj-x fl Wi(<&) = and Claim I implies that Uj fl Wi(<&) = 0. 

Proof. Observe that Uj \ Uj-\ is obtained as a player 2 attractor to Sj, and hence player 2 can ensure from 
Uj \ Uj-i that Sj is reached in finite number of steps. Since Biichi objective is independent of finite prefixes, 
by inductive hypothesis Uj-x n Wi(3>) = 0, and by Lemma [3^21 we have that Sj n Wi($) = 0, it follows that 
l7 i nWi(*) = 0. ' I 

Hence to complete the proof we need to establish Claim 1 and this is achieved in the following two lemmata. 
We start with the notion of a separating cut. 

Separating cut. We say a set S of vertices induces a separating cut in a graph G{ or G\ if (a) the only edges 
from S to V \ S come from player-2 vertices in S, (b) every player-2 vertex in S has an edge to another vertex 
in S, (c) every player- 1 vertex in S is white, and (d) B fl S = 0. Thus S is a player- 1 closed set where every 
player- 1 vertex is white and which does not contain a vertex in B. 

Lemma 3.4. Let G = ({V,E), (Vx, V2)) be a game graph where every vertex has at least outdegree 1, and 
G' = ((V, E'), (Vx, V2)) be a sub-graph of G with E 1 C E. Let Z be a set of blue player-1 and orange player-2 
vertices of G' such that all orange vertices have outdegree in G'. If S induces a separating cut in G', then no 
vertex of S belongs to Attrx{B U Z, G). 

Proof. We first show that every vertex in S has an edge to another vertex in S in G' . For player-2 vertices this 
follows from condition (b) of a separating cut. For player-1 vertices this follows since they have outdegree 1 in 
G, are white in G' , and cannot have an edge to a vertex in V \ S. 

Note that S fl (B U Z) = since S contains no blue vertex of Gi, every orange vertex in S has outdegree 
at least 1 and B n S = by condition (d) of a separating cut. By condition (a) for all player-1 vertices in 5 all 
out-going edges are in S. It follows that S is a player-1 closed set, and since S fl (B U Z) = 0, the result follows 
from Fact 1. I 

Lemma 3.5. We have Sj n Attrx{B 3 , G 3 ) = 0. 

Proof. Let v be a vertex in Sj. By construction v cannot alti -reach B 3 U Z\, in G\,, where i* was the last value 
of i in the repeat loop of iteration j. We will show that v cannot alti -reach B 3 in G 3 . If suffices to show that Sj 
induces a separating cut in G 3 . Then we can simply apply Lemma [3~4l with G = G 3 , G' = G\,, Z = 0, and 
S = Sj to prove the lemma. 



1. Condition (a). By construction no player- 1 vertex in Sj has an edge to V 3 \ Sj, otherwise it would belong 
to the player- 1 attractor of B 3 U Zf*. Since all player- 1 vertices in Sj are white in Gj,, the outedges of the 
player- 1 vertices in Sj are the same in Ef, and in E J . Thus condition (a) of a separating cut holds in G 3 . 

2. Condition (b). Every player-2 vertex in Sj must have an edge to another vertex in Sj, otherwise all its 
edges would go to vertices in V 3 \ Sj and thus it would belong to Attri(B 3 U Zf t ,G\„). Since EL C E 3 , 
the same holds in G 3 . Hence condition (b) of a separating cut holds in G 3 . 

3. Condition (c). All vertices are white in G 3 . Thus condition (c) holds trivially. 

4. Condition (d). The condition (d), Sj n B 3 ' = holds, since otherwise a vertex of Sj would belong to B 3 
and, thus, to Att ri (B 3 U Zf*,G\*). 

Thus Sj induces a separating cut in G 3 . The desired result follows. I 

Lemma 1331 proves Claim 1 and this completes the correctness proof, and gives the following lemma. 
LEMMA 3.6. Let Y* be the output o/NewAlgo. Then we have Y* = Wi($), where $ is the Biichi objective. 
Running time analysis. We now analyze the running time of the algorithm. 

LEMMA 3.7. Let G\ be a game graph in iteration j and let Zf be the set of blue and degree-0 orange vertices of 
G\ as defined in iteration j of the outer loop and i of the inner loop of the algorithm. If S induces a separating 
cut in G\, then S C Sj. 

Proof. None of the vertices in S can alti-reach B in G 3 by Lemma 1331 By Lemma 1341 none of the vertices in S 
can alti-reach B 3 U Z\. Hence we have S C V 3 \ Attn (B 3 U Zf, Gl). Thus S C Sj. I 

Since Sj is a complement of a player-2 attractor it is a player- 1 closed set, all vertices in Sj are white, and 
there is no Biichi vertex in Sj. Hence Sj is a separating cut. The previous lemma shows that every separating cut 
S is a subset of Sj. It follows that Sj is the largest (under set inclusion) separating cut. 

Lemma 3.8. The total time spent by NewAlgo is 0(n 2 ). 

Proof. We present the 0(n 2 ) running time analysis and we consider two cases. 

All other than the last iteration of the outer loop. Assume in iteration j the algorithm stops the repeat until loop 
at value i and this is not the last iteration of the algorithm. Then Sj is not empty. Note that all player- 1 vertices 
in Sj are white, since Zf contains all blue player- 1 vertices of V 3 and Sj = V 3 \ Attr\{B 3 U Zf, Gj). Thus, Sj 
induces a separating cut in G\. Consider the set Sj in G\_ v There are 2 cases to consider: 

Case 1: Sj contains a player- 1 vertex x that is blue in Gj_ 1 . Thus x has outdegree at least in Gj and 
none of these edges go to vertices in V 3 \ Sj in G\. Thus, Sj contains at least 2* _1 vertices. 

Case 2: All player- 1 vertices in Sj are white in Gj_ v Thus, their outedges in Gj and G J i _ 1 are identical. 

Note that no priority- 1 player-2 vertices in V 3 \ Sj point to vertices of Sj in G\. Since E\_ x C Ef it follows 
that no priority- 1 player-2 vertices in V 3 \ Sj point to vertices in Sj in G\_ x . Consider a player-2 vertex u in Sj. 
Thus there exists an edge (u, v) G E\ with v € Sj. There are two possibilities. 

Case 2a: For all player-2 vertices u € Sj there exists a vertex v € Sj with (u, v) € Ej_ 1 . But then Sj would 
be a separating cut in G\_ x . By Lemma 13771 it follows that Sj would be non-empty in iteration % — 1 and thus the 
repeat loop would have stopped after iteration i — This is not the case and thus the condition of Case 2a does 
not hold. 

Case 2b: There exists a player 2 vertex u € Sj that has an edge (u, v) G Ef to a vertex v € Sj but this 
edge is not contained in Ef_ v This can only happen if u is orange in G\_ x and v has 2* _1 other inedges in Ef_ 1 . 
Since the edge (u, v) where u is a priority-1 player-2 vertex is not in G J i _ 1 , all inedges of v that are in G^_ x are 



from priority-1 player-2 vertices by the fixed order of inedges. It follows that none of the inedges of v in G\_ x 
are from \ Sj and, thus, Sj must contain at least 2 l ~ l player-2 vertices. 

Thus in either case Sj contains at least 2 l ~ l vertices and all these vertices are deleted. The time spent for all 
the executions of the repeat loop in this iteration of the outer loop it the time spent in all graphs G\, G2, Gi*, 
which sums to 0(2* • n). We charge 0(n) work to each deleted vertex. This accounts for all but the last iteration 
of the outer loop. As the algorithm deletes at most n vertices the total time spent over the whole algorithm other 
than the last iteration is 0(n 2 ). 

The last iteration of the outer loop. In the last iteration of the outer loop, when no vertex is deleted, the algorithm 
works on all logn graphs, spending time 0(n ■ 2 r ) in graph Gi. Since there are logn graphs, the total time is 
0(n ■ 2 ■ 2 logn ) = 0(n 2 ). An identical argument also shows that the time to built all the initial graphs Gi is at 
most 0(n 2 ). Hence the desired result follows. I 

THEOREM 3.2. Given a game graph G with n vertices, and an BUchi objective $, algorithm NEWALGO 
correctly computes the winning set W\(<&) in time 0(n 2 ). 

4 Maximal End-component Decomposition Algorithm 

In this section we present an algorithm for the maximal end-component decomposition problem that runs in 
0(n 2 ) time. The maximal end-component problem is the core algorithmic problem in verification of probabilistic 
systems, and the graph theoretic description of the problem for game graphs is defined below. 

Maximal end-component decomposition. Given a game graph G = ((V, E), (Vi, V2)), an end-component 
U C V is a set of vertices such that (a) the graph (U, E n U x U) is strongly connected; (b) for all u G U fl V2 and 
all (u, u) Gfiwe have v G U; and (c) either \U\ > 2, or U = {v} and there is a self-loop at v (i.e., (v, v) G E). 
In other words, an end-component is a player-2 closed set that is strongly connected. Note that if U\ and U2 are 
end-components with U\ n U2 7^ 0, then U\ U U2 is an end-component. A maximal end-component (mec) is 
an end-component that is maximal under set inclusion. Every vertex of V belongs to at most one maximal end- 
component. The maximal end-component (mec) decomposition consists of all the maximal end-components of 
V and all vertices of V that do not belong to any maximal end-component. Maximal end-components generalize 
strongly connected components (scc's) for directed graphs (with V2 = 0) and closed recurrent sets for Markov 
chains (with V\ =0). 

Notations. Given a game graph G = ((V, E), (Vi, V2)), we will denote by Reachable(X, G) the set of vertices 
that can reach a vertex in X in the graph (V,E). Note that X C Reachable (X, G). We maintain log n graphs Gi 
such that Gi = (V, Ei) and E; L contains all edges (u, v) where outdeg(u) < 2\ We denote by G the full graph. 
We color vertices v in Gi blue if outdeg(v) > 2\ i.e., Blj = {v G V \ outdeg(v) > 2 % } and all other vertices are 
colored white, i.e., Whj = {v G V \ outdeg(v) < 2 1 }. Note that G = G\ ogn and thus all vertices in G\ ogn are 
white. Thus, none of the outedges of the blue vertices of Gi belong to Gi, i.e., all blue vertices have outdegree 
in Gi. A bottom sec C of a graph is a sec that has no edge leaving out of C. Every graph has a bottom sec and 
every bottom sec is a mec. 

Maximal end-component decomposition algorithm. The algorithm consists of two nested loops, an outer loop 
with loop counter j and an inner loop with loop counter i. The algorithm will iteratively delete vertices from the 
graph, and we denote by Dj the set of vertices deleted in iteration j. We will denote by G\ the sub-graph of Gi 
at the beginning of iteration j (as for NewAlgo) and the vertex set in iteration j is denoted as VK The set Br? 
is the set of vertices in G\ with outdegree greater than 2 % in G\. Basically the algorithm is similar to NewAlgo, 
and instead of searching for separating cuts, the algorithm for mec decomposition searches for bottom scc's. The 
steps of the algorithm are as follows and we refer the algorithm as NewMECAlgo. 

1. Let Dj be the set of vertices deleted in iteration j. For j := 0, let Dq := Attr2(X, G°), where X is the set 

of vertices that are in the bottom scc's in the initial graph G. Every bottom sec is an mec and included in 

the mec decomposition. 



2. Remove the vertices of Dj from all logn graphs G\ to create graph Gl +1 ; j := j + I. If all vertices are 
removed, then the whole algorithm terminates and outputs the mec decomposition. 

3. i := 1; 

4. repeat 

(a) Compute all the vertices in G\ that can reach the blue vertices using the standard linear-time algorithm 
for reachability. 

(b) Let Sj = Vi \ Reachable (Br?, G\) be the set of vertices that cannot reach the set Bl] blue vertices in 
G{;i:=i + 1 

5. until Sj is non-empty 

6. if Sj 7^ 0, then let Dj := Attr^X, G^), where X is the set of vertices that are in the bottom scc's in the 
sub-graph induced by Sj in G\ . Every bottom sec is an mec and included in the mec decomposition. Go 
to Step 2. 

Basic correctness argument. Let us denote G- 7 to be the remaining game graph after iteration j. Let Sj 
be the set identified at iteration j, and let the inner iteration stop at i*. All vertices in Sj are white, since 
Sj = Vi \ Reachable (Br?* , G\*) and Br], C Reachable (BrJ*, (?]»). For all v G Sj, all outedges from v end in 
a vertex in Sji otherwise if there is an edge from v to Reachable G^*), then v would have been included 
in Reachable (Blj*, G\*). Hence any bottom sec in the subgraph induced by Sj in G\* is also a bottom sec of 
G J . The correctness of the identification the bottom sec as an mec and removal of the attractor follows from 
the following two lemmata established in [7] (see Lemma 2.1 and Lemma 2.2 of Q). The first lemma below 
establishes that the player-2 attractor of a mec and the player-2 attractor of certain vertices of an sec do not belong 
to any mec and that it, thus, can be removed without affecting the mec decomposition of the remaining graph. 
Hence, the lemma is used to identify vertices that do not belong to any mec. The second lemma below shows 
under which condition an sec is an mec. Thus, it can be used to identify vertices that form a mec. It follows 
trivially from the second lemma that every bottom sec is a mec. 

LEMMA 4.1. ([7]) Let G = ((V, E), (Vi, V2)) be a game graph, and let (V, E) be the graph. 

1. Let C be a sec in (V, E). Let U = {v G C nV 2 \ Out(v) n (V \ C) ^ 0} be the player-2 vertices in C 
with edges out ofC. Let Z = Attr2(U, G) n C. Then for all non-trivial mec's X in G we have Z n X = 
and for any edge (u, v) with u G X and v G Z, u must belong to V\. 

2. Let C be a mec in G. Let Z = AttriiC, G) \ C. Then for all non-trivial mec's X with X ^ C in G we 
have Z n X = and for any edge (u, v) with and v G Z, u must belong to V\. 

Lemma 4.2. (Q) Let G = ((V, E), (Vi, V2)) be a game graph, and let (V, E) be the graph. Let C be a sec in 
(V, E) such that for all v G C nl^we have Out(v) C C. Then C is a mec. 

The correctness of the algorithm follows. 

LEMMA 4.3. Algorithm NEWMECALGO correctly computes the mec decomposition of a game graph. 

Running time analysis. The crucial result of the running time analysis depends on the following lemma. It 
shows that in an outer iteration j, if the inner iteration stops at iteration i* and X is the set of vertices identified 
as bottom sec, then X n Bl]*_ 1 is non-empty. 

LEMMA 4.4. Consider an outer iteration j of the algorithm, and let the inner iteration stop at iteration i*. Let 
X be hte set of vertices identified as bottom sec of the graph induced by S in G\*. Then X n Bl]»_ 1 ^ 0. 

Proof. Assume towards contradiction that there is a bottom sec C in the induced subgraph of S in G\* such 
that C fl Bl]»_ 1 = 0. Now we consider the iteration i* — 1 and then for every vertex in C in G J i *_ l all 



outedges end in a vertex in C. Since C does not contain a vertex from Blj*_ 1 and C has no outgoing edges, 
it follows that C C V 3 \ Reachable (Blj»_ 1 , G\„). Since all edges of G ? |*_ 1 are contained in it follows that 
C C V 3 ' \ Reachable (Bl]*_ 1 , G^»_ 1 ). It follows that a non-emptyset Sj would have been identified in iteration 
i* — 1, and this contradicts that the algorithm stops at iteration i* and not in i* — 1. I 

LEMMA 4.5. The total time spent by NewMECAlgo is 0(n 2 ). 

Proof. Assume that for an outer iteration j, the inner iteration stops the repeat until loop at value i* . By the 
previous lemma, one of the vertices v in X must have belong to Bl|»_ 1 and thus it has outdegree at least 2 4 *" 1 . 
Since we identify the bottom sec that contain v it must contain all the endpoints of the outedges from v. Hence 
X contains at least 2'* -1 vertices. The time spent for all the executions of the repeat loop in this iteration of the 
outer loop it the time spent in all graphs G\, G 3 2 , Gf*, which sums to 0(2** ■ n). We charge 0{n) to each 
deleted vertex. As the algorithm deletes at most n vertices the total time spent over the whole algorithm is 0(n 2 ). 
The removal of all the player-2 attractors overall iterations takes 0(m) = 0(n 2 ) time. Similar to the proof of 
Lemma [3781 the time required to built all the initial graphs Gj is at most 0(n 2 ). The result follows. I 

THEOREM 4.1. Algorithm NEWMECALGO correctly computes the mec decomposition of a game graph in 
0(n 2 ) time. 

5 Decremental and Incremental Algorithms 

In this section we present the decremental and incremental algorithms for computing the winning set in game 
graphs with Biichi objectives. We will show that the progress measure algorithm of ll20ll works in total time 
0(n ■ m) for a sequence of player- 1 edge deletions (or insertions), and hence the amortized time per operation is 
0(n). Since Biichi objectives generalize reachability objectives, and alternating game graphs generalize directed 
graphs, our algorithm is a generalization of the Even-Shiloach algorithm ifTTl for decremental reachability in 
graphs. However our proof is very different, based on a fix-point argument, and is much simpler. We first present 
the algorithm for the decremental case. 

5.1 Decremental algorithm for Biichi games In this section we present the decremental algorithm, and we 
consider only deletion of player- 1 edges. Our decremental algorithm is based on the notion of progress measure 
and we start with the notion of a progress measure and valid progress measure. 

Progress measure. Given a game graph with n vertices, a progress measure is a function p : V — > [n] U T, where 
[n] = {0,1,2,..., n}, that assigns to every vertex either a number from to n, or the top element T. We will 
follow the conventions that: (a) for all j G [n] we have j < T; (b) n + 1 = T; (c) T + 1 = T; (d) T > T. 
Given a game graph with a set B of Biichi vertices, a progress measure p is a valid progress measure if the 
following conditions hold for all v G V: (i) for v G V\ Pi B, we have p(v) = T if for all (v, w) G E we have 
p(w) = T, and otherwise; (ii) for v £ Vi D B, we have p(v) = T if there exists (v, w) € E with p(w) = T, 
and otherwise; (iii) for v € V\ \ B, we have p(v) = mm^ v w ^ eE p(w) + 1; and (iv) for v 6 V2 \ B, we have 
p(v) = max(„^) e£ p(w) + 1. We define the comparison operators <, > on progress measures with the pointwise 
comparison, i.e., for rxie {<, >} and progress measures p\ and P2, we write pi xi p2 iff for all v € V we have 
Pi(v) 1x1 p 2 (v). 

Lift operation on progress measure. Given a game graph G, the function Lift G takes as input a progress measure 
and returns a progress measure. For all input progress measures p, the output progress measure p' = Lift G (p) 
is defined as follows: for all v G V, (i) for v G V\ fl B, we have p'(v) = T if for all (v,w) G E we have 
p(w) = T, and otherwise; (ii) for v G V2 Pi B, we have p'(v) = T if there exists (v, w) G E with p(w) = T, 
and otherwise, (iii) for v G V% \ B, we have p'{v) = mhxt v>w \ & E p{ w ) + 1; an d (iv) for v G V2 \ B, we have 
p'{v) = max ( „^ )eE p(w) + 1. 



Lemma 5.1. For all game graphs G, the function Lift is monotonic (if pi < p%, then Lift (p±) < Lift (p2))- 
Proof. Consider progress measures p\, p2 such that p\ < p%. For a non-Biichi vertex v G (V \ B) we have 



where E 1 is the set of edges in G. It follows that for all v G (V \ B) we have Lift G (pi)(t;) < Lift G (p 2 )0). 
Note that for vertices in B, progress measures are either or T. For v G B we have the following cases: 
(i) i) 6 7i PI B: if Lift G (/?i)(u) = T, then for all (v, w) G E we have pi(u>) = T, and hence for all (v, w) £ E 
we have P2(w) = T; thus Lift (p2)(v) = T; and (i) v G V2 n -B: if Lift G (/?i)(-u) = T, then there exists 
G with pi(w) = T, and hence we have p2(w) = T; thus L\h G (p2)(v) = T. It follows that we have 
Lift G (,9i) < Lift G (p 2 )- The desired result follows. I 

Since Lift G is a monotonic function on a finite lattice, by the Tarski-Knaster Theorem |[22l it has a least 
fix-point. Given a player-1 attractor Attr\(U, G), the minimal alternating distance of a vertex v G ^4ttri(?7, G) 
is the rank rank(v) of the vertex v (in other words it is the alternating shortest distance to U where player-1 
minimizes the distance and player-2 maximizes the distance to U). The result of [20] established that for all 
game graphs G, (i) there is a unique least fix-point of Lift G , (ii) the least fix-point is a valid progress measure, 
(iii) in the winning set the progress measure equals the minimal alternating distance to the set of Biichi vertices 
in the winning set and all Biichi vertices in the winning set have progress measure 0, and (iv) all vertices in the 
complement of the winning set are assigned T. The result of ll20l is for the more general case of parity objectives, 
and the specialization to Biichi objectives yields the above properties. 

THEOREM 5.1. ( H20IO For all game graphs G, let p* be the least fix-point ofL\fc G , and let \\p*\\ = {v G V \ 
p(v) G [n] } denote the set of vertices that are not assigned the top element. Then \ \p*\\ = W\ (<£), where is the 
Biichi objective. 

Decremental algorithm. Our algorithm initially computes the least fix-point progress measure p* of the graph 
and then maintains it after each edge deletion by repeatedly applying the lift operator to the fix-point p* stored 
before the edge deletion. To prove the correctness we will show that the fix-point obtained by repeatedly applying 
the lift operator on the previous least fix-point converges to the least fix-point of the new game graph. The 
algorithm maintains the following data structure: (i) For each vertex x G V\ fl B it keeps a list of vertices w such 
that (x, w) G E and p*(w) ^ T and (ii) for each vertex x G V\ \ B a list of vertices w such that (x, w) G E and 
p*(x) = p*(w) + 1. (iii) Every edge (x, w) has a pointer to its location in the list of x if it is stored in such a list. 
We next describe the algorithm in detail. 

Computation of the initial p*. Use the static Biichi algorithm from the previous section to compute the player-1 
and player-2 winning sets and assign T to all vertices in the player-2 winning set. Use the backward search 
algorithm 0IT91 to determine the rank of every vertex in the player-1 winning set and set its initial progress 
measure equal to its rank. Then we compute for each vertex of V\ its list. 

Deletion of the edge (u,v). Maintain a queue of vertices to be processed to update the progress measure until 
the least fix-point is reached such that a vertex of V2 is only added to the queue when its progress measure has 
increased. Initially, enqueue u. Then iteratively process and dequeue the vertices from the queue. 

Case 1: A vertex x of V\ is dequeued. Check whether given the current progress measure, the progress 
measure of x needs to be increased to satisfy the lift operation for x. To do this we first check whether the list of 
x is empty. If it is not empty, nothing needs to be done. If it is empty, all remaining outedges of x are checked to 
compute the new progress measure value of x and the new list of x. Then all inedges (u, x) of x are processed 
as follows: If u is a player-1 non-Biichi vertex (u G V\ \ B), then it is enqueued (if it is not already in the queue) 
and x is removed from the list of u if it was there. If u is a player-2 non-Biichi vertex (u G V% \ B), then check 
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whether the change in the progress measure value of x also increases the progress measure value of u. If it does, 
then u is enqueued (if it is not already in the queue), otherwise u is not enqueued. If u is a player- 1 Biichi vertex 
(u 6 V\ H B), then (i) if the progress measure of x is not T, then do nothing; (ii) else remove x from the list of u, 
and if the list of u is empty, assign progress measure T to u and u is enqueued (if it is not already in the queue). 
If u is a player-2 Biichi vertex (u € V2 H B), then (i) if the progress measure of x is not T, then do nothing; 
(ii) else assign progress measure T to u and it is enqueued (if it is not already in the queue). 

Case 2: A vertex x of V2 is dequeued. In this case the progress measure of x has increased and it has already 
been updated. Thus all what remains is to process all inedges (u, x) of x as follows: If u is a player- 1 non-Biichi 
vertex, then it is enqueued (if it is not already in the queue) and x is removed from the list of u if it was there. If u 
is a player-2 non-Biichi vertex, then check whether the change in the progress measure value of x also increases 
the progress measure value of u. If it does, then u is enqueued (if it is not already in the queue), otherwise u is not 
enqueued. If u is a player-1 Biichi vertex, then (i) if the progress measure of x is not T, then do nothing; (ii) else 
remove x from the list of u, and if the list of u is empty, assign progress measure T to u and u is enqueued (if it 
is not already in the queue). If u is a player-2 Biichi vertex, then (i) if the progress measure of x is not T, then do 
nothing; (ii) else assign progress measure T to u and u is enqueued (if it is not already in the queue). 

This algorithm is a generalization of the Even-Shiloach algorithm ifTTl for maintaining the connected 
component (or more precisely the breadth-first-search tree) of a vertex b in an undirected graph. Assume B = {b} 
and that V = V\. Then the progress measure value of a vertex v is exactly u's level in the breadth-first search 
tree rooted at b (or equivalently its shortest path distance to b). Applying the lift operator to a vertex v is exactly 
the same as checking whether v has still an edge to an edge at level level(v) — 1 and if not, increasing the level 
of v by 1. 

Correctness. Let G be a game graph, and let p* be the least fix-point of Lift G . Let G = G \ {e}, where 
e € E fl V\ X V, be the game graph obtained by deleting a player-1 edge e. Let p* be the least fix-point of G. 
Let p* ew be the new fix-point obtained by iterating Lift G on p*. We will show that p* = p* ew . 

Lemma 5.2. We have p* < p* ew . 

Proof. Let po be the progress measure that assings to all vertices, i.e., the least progress measure. Clearly, po < 
p*. Let us denote by (Lift 6 )* the result of applying the lift operator z-times on G, for some i G N. From a simple 
application of Lemma [57X1 it follows that (Lift G ) J is monotonic. Hence we have (Lift G ) l (po) < (Lift G )*(p*). 
Since p* = (Lift G ) J (po) f° r some j, and p* em > (Lift G ) J (p*) for all % (in particular for the j for which the least 
fix-point is obtained from po)> it follows that p* < p* ew . I 

Lemma 5.3. We have p* ew < p*. 

Proof. Observe that the graph G is obtained by deleting an edge for player-1, and hence the winning set for 
player 1 can only decrease and the minimal alternating distance to the Biichi set in the winning set can only 
increase. In other words, we have p* < p*, i.e., the least fix-point of the graph G is smaller than the least fix- 
point of G. Since p* ew = (Lift G ) i (p*), for some i, we have p* ew = (Lift G ) i (p*) < ( Lift^)* (p* ) = p*, where the 
first inequality is a consequence of Lemma l5.1l that (Lift G )* is monotonic, and the last inequality is a consequence 
of the fact that p* is a fix-point. Hence the desired result follows. I 

The correctness follows from Lemma [5721 and Lemma [5731 (that p* ew = p*) and the fact that the algorithm 
implements the iteration of the lift operator on vertices one by one to compute the fix-point that is obtained by 
repeatedly applying the lift operator on the least fix-point of the previous game graph. 

Running time. The deletions of player- 1 edges only decreases the winning set, and once a set is removed from 
the winning set (i.e., assigned value T in the progress measure algorithm), then they are never worked upon. 
Upon termination, let W be the winning set, and let p be the least fix-point in the end. The computation of the 
initial least fix-point is done in time 0(n 2 ). 



In the decremental algorithm we check for each dequeued player- 1 vertex u whether its progress measure 
increases in constant time. If it does not increase no further work is done for u. The constant amount of work 
is charged to the edge deletion if an outedge of u was deleted. If no outedge of u was deleted then the progress 
measure of a vertex w with (u, w) G E must have increased and we charge the work to w. If the progress measure 
of u increases we spend time 0(|ln(n)| + \Out{u)\) to determine the new progress measure of u, compute its 
new list, and process all its inedges, and the work is charged to u. A player-2 vertex u is only enqueued when its 
progress measure has increased. When it is dequeued we spend time 0(|ln(u)|) to process all its inedges, and 
charge it to u. The number of times the progress measure can increase for a vertex is at most n + 1 (as once it is 
n + 1 it is assigned T). For a vertex v, let Num(u) = p{v), if p(v) / T, and n + 1 otherwise. Hence the total 
work done by the algorithm is 

0(Y^ Num(v) • |ln(v)|) + Num(t;) • \Out(v)\) = 0(n ■ m). 

vev vev 

THEOREM 5.2. Given an initial game graph with n vertices and m edges, the winning set partitions can be 
maintained under the deletion of 0{m) edges (u, v) with u G V\ in total time 0(n ■ m). 

5.2 Incremental algorithm for Biichi games We now present the details of the incremental algorithm for 
Biichi games, where we consider insertion of player- 1 edges. The algorithm is almost identical to the decremental 
algorithm and based on the dual progress measure for player 2. We start with the definition of a valid progress 
measure for player 2. 

Valid progress measure for player 2. Given a game graph with a set B of Biichi vertices, let C = V \ B be the 
set of coBiichi vertices. A progress measure p is a valid progress measure for player 2 if the following conditions 
hold for all v G V: 

min(„, w )g£ p(w) v eV 2 r\C; 

min ( „ iW ) e£ p(w) + 1 v eV 2 PiB; 
max(^ w ) e£ p(w) v e Vi n C; 
k m &X{v,w)eE P{w) + 1 v G V x fl B. 
We define the comparison operators < , > on progress measures with the pointwise comparison. 
Lift operation on progress measure. Given a game graph G, the function coLift , like the Lift function, takes as 
input a progress measure and returns a progress measure. For all input progress measures p, the output progress 
measure p' = coLift G (/9) is defined as follows: for all v G V, 

^^(v,w)€E p{w) V G v 2 n C 

mni(„, w ) e £ p(w) + 1 v G V 2 n B 
max ( ^ m ) e£ p(w) v G V\ (~1 C 

max (B)W)6£ p(w) + 1 v G V x fl B. 

LEMMA 5.4. For all game graphs G, the function coLift G is monotonic. 
Proof. Consider progress measures pi,p 2 such that p\ < p 2 . For a vertex v we have 

min^)^ pi(u>) < min ( ^) e£ p 2 (w) = coLift G (p 2 )(^) v G V 2 n C 

min-(v,w)eE Pi(w) + 1 < ^^(v,w)eE Pi{w) + 1 = coLift G (/9 2 )(i;) v G V 2 n B 

™®K{v,w)eE Pi(w) < max ( „ )U) ) eE p2(w;) = coLift G (p 2 )(f) v G Vi n C 

jn®K{v,w)eE Pi(w) + 1 < max (l))t „ )6£ p 2 (w) + 1 = coLift G (p 2 )(v) v G V-y fl B 

where E is the set of edges in G. It follows that coLift G (pi) < coLift G (p 2 ). The desired result follows. 



p{v) > < 



p'(v) = { 



coLift G ( Pl )(t;) 



Since coLift G is a monotonic function on a finite lattice, by Tarski-Knaster Theorem ll22l it has a least fix- 
point. Before we proceed to the characterization, we present a definition: for a vertex v G W2 where ^ is the 
coBiichi objective coBuchi(C), let maxvisit(u) = min^gn max CTe s \{i \ lu(v,(t,tt) = (vq,vi,V2, ■ ■ G B}\ 
denote the maximum number of visits to Biichi vertices. Since v G T4 / 2(^ / ), once a winning strategy for player-2 
is fixed, there cannot be a cycle with a Biichi vertex, and hence maxvisit(-u) < n. The result of |[20l established 
that for all game graphs G, (i) there is a unique least fix-point of coLift G , (ii) the least fix-point is a valid progress 
measure, (iii) for vertices v in the winning set for player 2 the progress measure equals maxvisit(w), and (iv) all 
vertices in the winning set for player 1 are assigned the top element T. The result of [20] is for the more general 
case of parity objectives, and the specialization to coBiichi objectives yields the above properties. 

Theorem 5.3. (HOl) For all game graphs G, let p* be the least fix-point o/coLift^, and let \ \p*\ \ = {v G V \ 
p{y) G [n]} denote the set of vertices that are not assigned the top element. Then \ \p*\\ = W^^), where ^ is 
the coBiichi objective. 

Incremental algorithm. Our algorithm initially computes the least fix-point progress measure p* of coLift of the 
graph and then maintains it after each edge insertion by repeatedly applying the lift operator coLift to the fix-point 
p* stored from before the edge insertion. To prove the correctness we will show that the fix-point obtained by 
repeatedly applying the lift operator on the previous least fix-point converges to the least fix-point of the new 
game graph. The algorithm maintains the following data structure: (i) For each vertex x G V2 D C it keeps a list 
of vertices w such that (x, w) G E and p*(x) = p*(w) and (ii) for each vertex x G V2 D B a list of vertices w 
such that (x, w) G E and p*(x) = p*(w) + 1. (iii) Every edge (x, w) has a pointer to its location in the list of x 
if it is stored in such a list. We next describe the algorithm in detail. We first describe the insertion of an edge as 
the initial fix-point computation is similar. 

Insertion of the edge (u, v). Maintain a queue of vertices to be processed to update the progress measure until 
the least fix-point is reached such that a vertex of V\ is only added to the queue when its progress measure has 
increased. Initially, enqueue u. Then iteratively process and dequeue the vertices from the queue. 

Case 1: A vertex x of V2 is dequeued. Check whether given the current progress measure, the progress 
measure of x needs to be increased to satisfy the lift operation for x. To do this we first check whether the list of 
x is empty. If it is not empty, nothing needs to be done. If it is empty, all remaining outedges of x are checked to 
compute the new progress measure value of x and the new list of x. Then all inedges (u, x) of x are processed 
as follows: If u is a player-2 vertex it is enqueued (if it is not already in the queue) and x is removed from the 
list of u if it was there. If u is a player- 1 vertex then check whether the change in the progress measure value of 
x also increases the progress measure value of u. If it does, then u is enqueued (if it is not already in the queue), 
otherwise u is not enqueued. 

Case 2: A vertex x of V\ is dequeued. In this case the progress measure of x has increased and it has already 
been updated. Thus all what remains is to process all inedges (u, x) of x as follows: If u is a player-2 vertex it is 
enqueued (if it is not already in the queue) and x is removed from the list of u if it was there. If u is a player- 1 
vertex then check whether the change in the progress measure value of x also increases the progress measure 
value of u. If it does, then u is enqueued (if it is not already in the queue), otherwise u is not enqueued. 

Computation of the initial p*. The computation of the initial p* is similar to the incremental algorithm. We 
initialize the initial progress measure as for all vertices, then enqueue the set of Biichi vertices, and proceed as 
the incremental algorithm until a fix-point is reached. As we start with the all progress measure and repeatedly 
apply the lift operator we are guaranteed to reach the least fix-point. Then we compute for each vertex v G V2 its 
list. 

Correctness. Let G be a game graph, and let p* be the least fix-point of coLift G . Let G = G U {e}, where 
e G E H V\ x V, be the game graph obtained by inserting a player- 1 edge e. Let J>* be the least fix-point of G. 
Let p* ew be the new fix-point obtained by iterating coLift on p*. We will show that ~p* = p^ ew . 



Lemma 5.5. We have p* < p* 



Proof. Let po be the progress measure that assings to all vertices, i.e., the least progress measure. Clearly, 
Po < p* ■ Let us denote by (coLift G )* the result of applying the lift operator i-times on G, for some 
i S N. From a simple application of Lemma 15.41 it follows that (col_ift G ) J is monotonic. Hence we have 

(coLift G ) i (p ) < {col\h G y(p*). Since p* = (coLift G y (p ) for some j, and p* ew > (coLift 6 ')^/?*) for all i (in 
particular for the j for which the least fix-point is obtained from po), it follows that p* < p„ ew . I 

Lemma 5.6. We have p* ew < p*. 

Proof. Observe that the graph G is obtained by inserting an edge for player- 1, and hence the winning set for 
player 2 can only decrease and maxvisit(?;) can only increase for vertices in the winning set for player 2. In other 
words, we have p* < p*, i.e., the least fix-point of the graph G is smaller than the least fix-point of G. Since 
Pnew = (coLift G ) J (p*), for some i, we have 

p* new = (coLift G ) V) < (coLift^V) = t, 

where the first inequality is a consequence of Lemma 15 .41 that (coLift G )* is monotonic, and the last inequality is 
a consequence of the fact that p* is a fix-point. Hence the desired result follows. I 

Lemma 5.7. We have p* ew = p*. 

Correctness. The correctness follows from Lemma \5J] and the fact that the algorithm implements the iteration 
of the lift operator on vertices one by one to compute the fix-point that is obtained by repeatedly applying the lift 
operator on the least fix-point of the previous game graph. 

Running time. The insertions of player- 1 edges only decreases the winning set for player 2, and once a set is 
removed from the winning set (i.e., assigned value T in the progress measure algorithm), then they are never 
worked upon. Upon termination, let W be the winning set, and let p be the least fix-point in the end. In the 
incremental algorithm we check for each dequeued player-2 vertex u whether its progress measure increases in 
constant time. If it does not increase no further work is done for u. Since u is processed, the progress measure 
of a vertex w with (u, w) G E must have increased and we charge the work to w. If the progress measure of u 
increases, then we spend time 0(|ln(u)| + \Out(u)\) to determine the new progress measure of u, compute its 
new list, and process all its inedges, and charge the work to u. A player- 1 vertex u is only enqueued when its 
progress measure has increased, or an edge is inserted at u. If an edge was inserted, the work is charged to the 
inserted edge. When it is dequeued we spend time 0(|ln(ii)|) to process all its inedges, and charge it to u. The 
number of times the progress measure can increase for a vertex is at most n + 1 (as once it is n + 1 it is assigned 
T). For a vertex v, let Num(u) = p(v), if p(v ) ^ T, and n + 1 otherwise. Hence the total work done by the 
algorithm is 

0(^2 Num(u) • |ln(«)|) + 0( Num(v) • \Out(v)\) = 0(n ■ m). 

An argument similar to the above also establishes that the initial least fix-point is computed in time 0(n ■ m). 

THEOREM 5.4. Given an initial game graph with n vertices and m edges, the winning set partitions can be 
maintained under the insertion ofO(m) edges (u, v) with u € V\ in total time 0{n ■ m). 

Acknowledgements. The research was supported by Austrian Science Fund (FWF) Grant No P 23499-N23 on 
Modern Graph Algorithmic Techniques in Formal Verification, ERC Start grant (279307: Graph Games), and 
Microsoft faculty fellows award. 



References 



[ 1 ] R. Alur, T.A. Henzinger, and O. Kupferman. Alternating-time temporal logic. Journal of the ACM, 49:672-7 13, 2002. 
[2] C. Beeri. On the membership problem for functional and multivalued dependencies in relational databases. ACM 

Trans, on Database Systems, 5:241-259, 1980. 
[3] J.R. Biichi. Weak second-order arithmetic and finite automata. Zeitschrift filr mathematische Logik und Grundlagen 

der Mathematik, 6:66-92, 1960. 
[4] J.R. Biichi. On a decision method in restricted second-order arithmetic. In E. Nagel, R Suppes, and A. Tarski, editors, 

Proceedings of the First International Congress on Logic, Methodology, and Philosophy of Science 1960, pages 1-11. 

Stanford University Press, 1962. 
[5] J.R. Biichi and L.H. Landweber. Solving sequential conditions by finite-state strategies. Transactions of the AMS, 

138:295-311,1969. 

[6] A. K. Chandra, D. Kozen, and L. J. Stockmeyer. Alternation. J. ACM, 28(1): 1 14-133, 1981. 

[7] K. Chatterjee and M. Henzinger. Faster and dynamic algorithms for maximal end-component decomposition and 

related graph problems in probabilistic verification. In SODA' 11. SIAM, 201 1. 
[8] K. Chatterjee, T.A. Henzinger, and N. Piterman. Algorithms for Biichi games. In Games in Design and Verification 

(GDV),2006. 

[9] K. Chatterjee, M. Jurdzihski, and T.A. Henzinger. Simple stochastic parity games. In CSL'03, volume 2803 of LNCS, 
pages 100-113. Springer, 2003. 
[10] K. Chatterjee, M. Jurdzihski, and T.A. Henzinger. Quantitative stochastic parity games. In SODA'04, pages 121-130. 
SIAM, 2004. 

[11] A. Church. Logic, arithmetic, and automata. In Proceedings of the International Congress of Mathematicians, pages 

23-35. Institut Mittag-Leffler, 1962. 
[12] A. Condon. The complexity of stochastic games. Information and Computation, 96(2):203-224, 1992. 
[13] C. Courcoubetis and M. Yannakakis. The complexity of probabilistic verification. Journal of the ACM, 42(4):857- 

907, 1995. 

[14] L. de Alfaro and T.A. Henzinger. Interface automata. In FSE'01, pages 109-120. ACM Press, 2001. 
[15] D.L. Dill. Trace Theory for Automatic Hierarchical Verification of Speed-independent Circuits. The MIT Press, 1989. 
[16] E.A. Emerson and C. Jutla. Tree automata, mu-calculus and determinacy. In FOCS'91, pages 368-377. IEEE, 1991. 
[17] S. Even and Y. Shiloach. An on-line edge-deletion problem. J. ACM, 28(l):l-4, 1981. 

[18] M. R. Henzinger, V. King, and T. Warnow. Constructing a tree from homeomorphic subtrees, with applications to 

computational evolutionary biology. Algorithmica, 24(1): 1—13, 1999. 
[19] N. Immerman. Number of quantifiers is better than number of tape cells. Journal of Computer and System Sciences, 

22:384-406,1981. 

[20] M. Jurdzihski. Small progress measures for solving parity games. In STACS'00, pages 290-301. LNCS 1770, 
Springer, 2000. 

[21] M. Jurdzihski, O. Kupferman, and T. A. Henzinger. Trading probability for fairness. In CSL: Computer Science 

Logic, Lecture Notes in Computer Science 2471, pages 292-305. Springer, 2002. 
[22] A. Kechris. Classical Descriptive Set Theory. Springer, 1995. 

[23] O. Kupferman and M.Y Vardi. From linear time to branching time. ACM Transactions on Computational Logic, 
6(2)273-294,2005. 

[24] A. Mahanti and A. Bagchi. AND/OR graph heuristic search methods. JACM, 32(1)28-51, 1985. 
[25] R. McNaughton. Infinite games played on finite graphs. Annals of Pure and Applied Logic, 65:149-184, 1993. 
[26] A. Pnueli and R. Rosner. On the synthesis of a reactive module. In POPL'89, pages 179-190. ACM Press, 1989. 
[27] P.J. Ramadge and W.M. Wonham. Supervisory control of a class of discrete-event processes. SIAM Journal of Control 

and Optimization, 25(1)206-230, 1987. 
[28] W. Thomas. Languages, automata, and logic. In G. Rozenberg and A. Salomaa, editors, Handbook of Formal 

Languages, volume 3, Beyond Words, chapter 7, pages 389^-55. Springer, 1997. 
[29] M.Y. Vardi. Automata-theoretic model checking revisited. In Proc. of Verification, Model Checking, and Abstract 

Interpretation, volume LNCS 4349, pages 137-150. Springer, 2007. 
[30] M.Y. Vardi. The Biichi complementation saga. In Proc. ofSymp. on Theoretical Aspects of Computer Science, volume 

LNCS 4393, pages 12-22. Springer, 2007. 



[31] W. Zielonka. Infinite games on finitely coloured graphs with applications to automata on infinite trees. In Theoretical 
Computer Science, volume 200(1-2), pages 135-183, 1998. 



